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Amendments to the Drawings 

Replacement formal drawings are submitted herewith for Figs. 3, 7, 8, 9, 10, 13-19 and 
25. The changes incorporated in these replacement formal drawings are the following: 



In FIG. 3: 

"TAP INTERVAL TIME" has been changed to "TAP TIME INTERVAL" 
"KEY-DOWN TIMING" has been changed to "KEY-DOWN TIME" 
"KEY-UP TIMING" has been changed to "KEY-UP TIME" 

In FIG. 7: 

S202: "IS THERE THE NEXT TAP INPUT WITHIN AN END INTERVAL TIME?" 
has been changed to "IS THERE THE NEXT TAP INPUT WITHIN AN END TIME 
INTERVAL?" 

S203: "LARGER THAN A PROLONGED SOUND INTERVAL TIME?" has been 
changed to "LARGER THAN A PROLONGED SOUND TIME INTERVAL?" 

In FIG. 8: 

"TAP INTERVAL TIME" has been changed to "TAP TIME INTERVAL" 
"KEY-DOWN TIMING" has been changed to "KEY-DOWN TIME" 
"KEY-UP TIMING" has been changed to "KEY-UP TIME" 

In FIG. 9: 

"TAP INTERVAL TIME" has been changed to "TAP TIME INTERVAL" 
"KEY-DOWN TIMING" has been changed to "KEY-DOWN TIME" 
"KEY-UP TIMING" has been changed to "KEY-UP TIME" 



In FIG. 10: 
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"TAP INTERVAL TIME" has been changed to "TAP TIME INTERVAL" 
"KEY-DOWN TIMING" has been changed to "KEY-DOWN TIME" 
"KEY-UP TIMING" has been changed to "KEY-UP TIME" 

In FIG. 13: 

S304: "IS THERE THE NEXT TAP INPUT WITHIN AN END INTERVAL TIME?" 
has been changed to "IS THERE THE NEXT TAP INPUT WITHIN AN END TIME 
INTERVAL?" 

S305: "LARGER THAN A PROLONGED SOUND INTERVAL TIME?" has been 
changed to "LARGER THAN A PROLONGED SOUND TIME INTERVAL?" 

In FIG. 14: 

S401 : "RECORD A TAP INTERVAL TIME" has been changed to "RECORD A TAP 
TIME INTERVAL" 

S402: "IS THERE THE NEXT TAP INPUT WITHIN AN END INTERVAL TIME?" 
has been changed to "IS THERE THE NEXT TAP INPUT WITHIN AN END TIME 
INTERVAL?" 

S41 1 : "TAP INTERVAL TIME AVERAGE ?PROLONGED SOUND INTERVAL 
TIME?" has been changed to'TAP TIME INTERVAL AVERAGE? PROLONGED SOUND 
TIME INTERVAL?" 

In FIG. 15: 

"ACTUAL TAP INTERVAL TIME Ti (ms)" has been changed to "ACTUAL TAP TIME 
INTERVAL Ti (ms)" 

In FIG. 16: 
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"ASSUMED TAP INTERVAL TIME (ms)" has been changed to "ASSUMED TAP 
TIME INTERVAL (ms)" 

In FIG. 17: 

"ASSUMED TAP INTERVAL TIME (ms)" has been changed to "ASSUMED TAP 
TIME INTERVAL (ms)" 

In FIG. 18: 

S501 : "RECORD A TAP INTERVAL TIME" has been changed to "RECORD A TAP 
TIME INTERVAL" 

S502: "IS THERE THE NEXT TAP INPUT WITHIN AN END INTERVAL TIME?" 
has been changed to "IS THERE THE NEXT TAP INPUT WITHIN AN END TIME 
INTERVAL?" 

S505: "OBTAIN A SMALLEST TAP INTERVAL TIME" has been changed to 
"OBTAIN A SMALLEST TAP TIME INTERVAL" 

S506: "SELECT ONE TAP INTERVAL TIME" has been changed to "SELECT ONE 
TAP TIME INTERVAL" 

S508: "DETERMINE A PATTERN IN THE SELECTED TAP INTERVAL TIME AS 
"x-"" has been changed to "DETERMINE A PATTERN IN THE SELECTED TAP TIME 
INTERVAL AS "x-"" 

S510: "DETERMINE A PATTERN IN THE SELECTED TAP INTERVAL TIME AS 
"x"" has been changed to "DETERMINE A PATTERN IN THE SELECTED TAP TIME ' 
INTERVAL AS "x-"" 

In FIG. 19: 

S60: "MEMORIZE AN AMPLITUDE LEVEL AT A KEY-DOWN TIMING" 
has been changed to "MEMORIZE AN AMPLITUDE LEVEL AT A KEY-DOWN TIMEl 
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S602: "RECORD A TAP INTERVAL TIME" has been changed to "RECORD A TAP 
TIME INTERVAL" 

S603: "IS THERE THE NEXT TAP INPUT WITHIN AN END INTERVAL TIME?" 
has been changed to "IS THERE THE NEXT TAP INPUT WITHIN AN END TIME 
INTERVAL?" 

S605: "SELECT AN AMPLITUDE LEVEL OF ONE KEY-DOWN TIMING" has been 
changed to "SELECT AN AMPLITUDE LEVEL OF ONE KEY-DOWN TIME" 

S608: "HAVE ALL KEY-DOWN TIMINGS BEEN SELECTED?" has been changed to 
"HAVE ALL KEY-DOWN TIMES BEEN SELECTED?" 

In FIG. 25: 

S902: "IS THERE THE NEXT TAP INPUT WITHIN AN END INTERVAL TIME?" 
has been changed to "IS THERE THE NEXT TAP INPUT WITHIN AN END TIME 
INTERVAL?" 

S904: "LARGER THAN A PROLONGED SOUND INTERVAL TIME?" has been 
changed to "LARGER THAN A PROLONGED SOUND TIME INTERVAL?" 
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CONTROL SYSTEM, METHOD, AND PROGRAM USING RHYTHM PATTERN 



5 TECHNICAL FIELD 

[0001] The present invention relates to a system for 

controlling operations of various apparatuses . More particularly, 
the present invention relates to a systemproviding a user interface 
for employing a small number of operating devices to control 
10 operations of various apparatuses. 



BACKGROUND ART 

[0002] Recent various apparatuses, such as, particularly, 

AV apparatuses (e.g., television, video and audio apparatuses, 

15 etc.), in-vehicle apparatuses (e.g., car navigation and car audio 
apparatuses, etc.) and the like, have considerably many functions . 
Along with it, the number of operating devices, such as keys and 
joysticks, which are mounted on an apparatus body or a remote 
controller, is increased. The increased number of operating 

20 devices makes it difficult to operate the apparatus. 

[0003] Also, it is difficult to arrange input devices 

supporting tens or hundreds of functions in a limited space. 
[0004] To solve such problems, various systems have been 

proposed. For example, a system has been proposed in which 

25 functions are organized into a hierarchical structure so that the 
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number of operating devices is reduced. This system is only 
provided with an operating device for selecting a hierarchical 
level and an operating device for selecting a function in the 
selected hierarchical level. 
5 [0005] Alternatively, a system capable of reducing the number 

of operating devices by using speech recognition has been proposed . 
This system is only provided with an operating device for indicating 
the start of speech recognition and a microphone for inputting 
speech. Therefore, the number of operating devices can be 

10 dramatically reduced. 

[0006] However, in the case of the system in which functions 

are organized into a hierarchical structure, the user has to always 
recognize which hierarchical level is currently in a selected mode 
in order to correctly select a desired function. In other words, 

15 the systemneeds to always inform the user of the currently selected 
mode using an image or audio, a state of a switch, or the like. 
The user also needs to select an appropriate hierarchical level 
by operating an operating device many times in order to select 
a desired function. The user cannot select a desired function 

20 by one-time operation. In order to correctly select a desired 
function, the user also needs to recognize how functions possessed 
by a system are organized into a hierarchical structure. These 
requirements are a barrier against the introduction of the system 
for the user who is bad with machines. 

25 [0007] Systems employing speech recognition have a problem 
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such that the speech recognition rate is impaired depending on 
the surrounding situation, such as surrounding noise, background 
music, the user' s voice, the position of a microphone, or the like. 
When the speech recognition rate is impaired, a desired function 
5 is not eventually performed . In other words , variations in speech 
recognition disable reliable operations. Also, speech 
recognition requires a large-capacity memory and high computation 
speed. Therefore, systems with a poor memory and low computation 
speed cannot achieve practical speech recognition speed. 
10 [0008] Therefore, an object of the present invention is to 

provide a system capable of reliably performing a desired function 
by utilizing a small number of operating devices in accordance 
with the user's operation instruction. 

15 DISCLOSURE OF THE INVENTION 

[0009] To achieve the above object, the present invention 

has the following aspects. 

[0010] A first aspect of the present invention is directed 

to a control system for controlling an operation of at least one 

20 apparatus, comprising: 

a rhythm input section of outputting, as an input rhythm 
signal, anelectrical signal whose amplitude level varies depending 
on a tap input from a user, the tap input corresponding to a 
pronunciation pattern of a name indicating the contents of a control 

25 of the apparatus; 
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a rhythm dictionary storage section of storing a rhythm 
dictionary table for associating the contents of the control of 
the apparatus with a registered rhythm pattern typifying the 
pronunciation pattern of the name indicating the contents of the 
5 control; and 

a control section of controlling the operation of the 
apparatus , 

wherein the control section comprises: 

an input rhythm pattern recognition means of analyzing 
10 the input rhythm signal input from the rhythm input section to 
recognize an input rhythm pattern; and 

an apparatus control means of referencing the rhythm 
dictionary table to search for a registered rhythm pattern matching 
the input rhythm pattern recognized by the input rhythm pattern 
15 recognition means, and based on the contents of the control 
corresponding to the registered rhythm pattern, controlling the 
apparatus . 

[0011] According to the above-described first aspect, an 

operation of each apparatus is controlled only by the user tapping 

20 a rhythm input section. Therefore, a control system which can 
control an operation of each apparatus using such small a number 
of input devices as possible (typically, one switch or sensor) , 
is provided. Further, a control system without being affected 
by noise is provided . Further, the user can operate each apparatus 

25 only by inputting a rhythm pattern in accordance with a rhythm 



of a natural language, thereby providing a control system having 
satisfactory operability. Further, the user can be expected to 
acquire operations quickly. 

[0012] Preferably, in the rhythm dictionary table, the 

5 registered rhythm pattern may be defined by dividing the name 
indicating the contents of the control into at least one 
predetermined unit, and thereafter, assigning apredeterminedunit 
rhythm pattern to each divided unit, and 

the input rhythm pattern recognition means may recognize 
10 the input rhythm pattern by simplifying a temporal change in the 
amplitude level of the input rhythm signal. 

[0013] Thereby, the input rhythm pattern is recognized by 

simplifying a temporal change in the amplitude level of an input 
rhythm signal, resulting in an increase in the possibility that 
15 the recognized input rhythm pattern matches the rhythm pattern 
intended by the user. As a result, a control system which can 
control an operation of each apparatus in a manner intended by 
the user, is provided. 

[0014] Preferably, the unit rhythm pattern may be defined 

20 by assigning the presence or absence of a beat to the presence 

or absence of a sound in the predetermined unit, and 

the input rhythm pattern recognition means may recognize 

a beat timing at which the user taps the rhythm input section and/or 

a silent beat timing at which no tap is made for a predetermined 
25 time, based on the temporal change in the amplitude level, and 




may recognize the input rhythm pattern by representing the temporal 
change of the input rhythm signal using the beat and/or silent 
beat timing. 

[0015] Thereby, the input rhythm pattern is recognized by 

5 a simple algorithm such that a beat and/or a silent beat are 
recognized by determining whether or not the tap interval time 
time interval exceeds a predetermined time, thereby making it 
possible to reduce an increase in process load of the control system. 
Further, the sizes of a memory and a program which are consumed 

10 are minimized. 

[0016] Further, an intensity of the sound of the predetermined 

unit may be further defined in the unit rhythm pattern, and 

the input rhythm pattern recognition means may further 
recognize an intensity of a tap at the beat timing in a stepwise 

15 manner based on an intensity of the amplitude level, and represent 
the intensity of the tap at the beat timing so that a strong tap 
is distinguished from a weak tap to recognize the input rhythm 
pattern. 

[0017] Thereby, since the name of the contents of a control 

20 intended by the user is recognized in association with the intensity 
of a sound, a user-friendly control system is provided for users 
who speak a language in which a difference between accents or 
intonations is important (e.g./ English, etc.). Further, by 
defining a difference between accents, the number of registered 
25 rhythm patterns can be increased. As a result, a larger number 



of control contents are defined. 

[0018] Further, the input rhythm pattern recognition means 

may further recognizes the input rhythm pattern such that there 
are a beat time and a silent beat time when the user continues 
5 to press the rhythm input section for the predetermined interval 
time time interval . 

[0019] Thereby, when the rhythm input section is pressed 

continuously, the control system can determine that a prolonged 
sound is input. 

10 [0020] Preferably, the unit rhythm pattern may be defined 

by assigning the presence or absence of a beat to the presence 
or absence of a sound in the predetermined unit, and 

the input rhythm pattern recognition means may detect the 
presence or absence of the beat based on the degree of the amplitude 

15 level, assume all possible rhythm patterns having beats in the 
number of detected beats, search the assumed rhythm patterns for 
a rhythm pattern best matching a tendency of the temporal change 
of the input rhythm signal, and recognize the retrieved rhythm 
pattern as the input rhythm pattern. 

20 [0021] Thereby, the control system recognizes an input rhythm 

pattern based on a tendency of a whole temporal change in an input 
rhythm signal, thereby making it possible to absorb differences 
in tap speed or the like among individuals to recognize the input 
rhythm pattern. Therefore, a control system which can control 

25 each apparatus more reliably is provided. 



[0022] In this case, the input rhythm pattern recognition 

means may obtain a difference between a time interval between two 
adjacent beats in the assumed rhythm pattern and a time interval 
between two adjacent beats in the input rhythm signal, and may 
5 recognize a rhythm pattern having a smallest average value of the 
difference among the assumed rhythm patterns as the input rhythm 
pattern . 

[0023] Thereby, the control system only obtains a difference 

in time interval and calculates an average value, thereby making 

10 it possible to recognize a rhythm pattern best matching a tendency 
of the temporal change. Therefore, a control system which can 
use a simple algorithm to recognize a rhythm pattern is provided. 
[0024] Further, when the beats are equally spaced in the 

recognized input rhythm pattern, the input rhythm pattern 

15 recognitionmeans may further determine whether or not the interval 
of the beat exceeds a predetermined interval time time interval , 
and when the interval of the beat exceeds the predetermined interval 
time time interval , newly recognize that the input rhythm pattern 
is a rhythm pattern in which a beat and a silent beat are continually 

20 repeated, or when the interval of the beat does not exceed the 
predetermined interval time time interval , newly recognize that 
the input tap pattern is a rhythm pattern in which only a beat 
is continually repeated. 

[0025] Thereby, the control system can newly recognize 

25 whether an input rhythm pattern is composed of only a beat or a 
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repetition of a beat and a silent beat . Therefore, a control system 
which can recognize an input rhythm pattern more reliably is 
provided . 

[0026] Further, an intensity of the sound of the predetermined 

5 unit may be further defined in the unit rhythm pattern, and 

the input rhythm pattern recognition means may further 
recognize an intensity of a tap at the beat timing in a stepwise 
manner based on an intensity of the amplitude level, and represent 
the intensity of the tap at the beat timing so that a strong tap 
10 is distinguished from a weak tap to recognize the input rhythm 
pattern . 

[0027] Preferably, the unit rhythm pattern may be defined 

by assigning the presence or absence of a beat to the presence 
or absence of a sound in the predetermined unit, and 

15 the input rhythm pattern recognition means may search the 

rhythm patterns registered in the rhythm dictionary table for a 
rhythm pattern best matching a tendency of the temporal change 
of the input rhythm signal, and recognize the retrieved rhythm 
pattern as the input rhythm pattern. 

20 [0028] Thereby, the control system can select an input rhythm 

pattern to be selected among registered rhythm patterns. 
Therefore, a situation is avoided such that no registered rhythm 
pattern matching a recognized input rhythm pattern is registered 
in a rhythm dictionary table. As a result, a control system which 

25 can reliably control an operation of each apparatus in a manner 



desired by the user is provided. 

[0029] In this case, the input rhythm pattern recognition 

means may detect the presence or absence of the beat based on the 
degree of the amplitude level, search the rhythm patterns 
5 registered in the rhythm dictionary table for a rhythm pattern 
having beats in the number of the detected beats, and further search 
the retrieved rhythm patterns for a rhythm pattern best matching 
a tendency of the temporal change, and recognize the finally 
retrieved rhythm pattern as the input rhythm pattern. 
10 [0030] Thereby, the number of rhythm patterns to be searched 

is decreased, thereby reducing the process load of the control 
system. 

[0031] Specifically, when further searching for a rhythm 

pattern best matching the tendency of the temporal change, the 

15 input rhythm pattern recognition means may obtain a difference 
between a time interval between two adjacent beats in the retrieved 
rhythm pattern and a time interval between two adjacent beats in 
the input rhythm signal, and recognize a rhythm pattern having 
a smallest average value of the difference among the retrieved 

20 rhythm patterns as the input rhythm pattern. 

[0032] Further, an intensity of the sound of the predetermined 

unit may be further defined in the unit rhythm pattern, and 

the input rhythm pattern recognition means may further 
recognize an intensity of a tap at the beat timing in a stepwise 

25 manner based on an intensity of the amplitude level, and represent 

10 



the intensity of the tap at the beat timing so that a strong tap 
is distinguished from a weak tap to recognize the input rhythm 
pattern . 

[0033] Preferably, the unit rhythm pattern may be defined 

5 by assigning the presence or absence of a beat to the presence 
or absence of a sound in the predetermined unit, and 

the input rhythm pattern recognition means may detect the 
presence or absence of the beat based on the degree of the amplitude 
level, obtain a smallest one of time intervals between two adjacent 

10 beats in the input rhythm signal, determine whether or not there 
is a silent beat between the two adjacent beats based on a relative 
value obtained by comparing the smallest time interval and a time 
interval between two other beats , and represent the temporal change 
of the input rhythm signal using a timing of the beat and/or the 

15 silent beat to recognize the input rhythm pattern. 

[0034] Thereby, the control system recognizes an input rhythm 

pattern by relative evaluation. Therefore, the input rhythm 
pattern can be recognized while absorbing differences in tap speed 
or the like among individuals. Therefore, a control system which 

20 can control each apparatus more reliably is provided. 

[0035] In this case, an intensity of the sound of the 

predetermined unitmay be further defined in the unit rhythm pattern, 
and 

the input rhythm pattern recognition means may further 
25 recognize an intensity of a tap at the beat timing in a stepwise 

11 
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manner based on an intensity of the amplitude level, and represents 
the intensity of the tap at the beat timing so that a strong tap 
is distinguished from a weak tap to recognize the input rhythm 
pattern. 

5 [0036] Preferably, the predetermined unit for dividing the 

name of the contents of the control may be a mora unit. 
[0037] Thereby, a name indicating the contents of a control 

is divided into moras. The user can input a rhythm in accordance 
with a rhythm naturally uttered. Therefore, a user-friendly 
10 control system is provided. It is particularly effective for 
languages, such as Japanese, to divide the contents of a control 
into moras . 

[0038] Further, preferably, the predetermined unit for 

dividing the name of the contents of the control may be a syllabic 
15 unit. 

[0039] Thereby, a name indicating the contents of a control 

is divided into syllabic units. The user can input a rhythm in 
accordance with a rhythm naturally uttered. Therefore, a 
user-friendly control system is provided. It is particularly 
20 effective for languages, such as English, to divide the contents 
of a control into syllabic units. 

[0040] Preferably, the control section may further comprise 

a rhythm pattern edition means of editing contents registered in 
the rhythm dictionary table in response to an instruction of the 
25 user. 
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[0041] Thereby, the rhythm dictionary table is customized. 

[0042] For example, the rhythm pattern editionmeans may cause 

the input rhythm pattern recognition means to recognize an input 
rhythm pattern intended by the user tapping the rhythm input section, 
5 and register the input rhythm pattern as a registered rhythm pattern 
in the rhythm dictionary table. 

[0043] Thereby, the rhythm dictionary table is edited by a 

rhythm pattern input by the user, and therefore, the rhythm 
dictionary table is constructed taking into account each user's 

10 way of tapping. 

[0044] Further, the rhythm pattern edition means may divide 

the name of a control represented by character information input 
by the user into at least one predetermined unit, assign a 
predetermined unit rhythm pattern to each divided unit to define 

15 a rhythm pattern, and register the rhythm pattern as a registered 
rhythm pattern in the rhythm dictionary table. 
[0045] Thereby, the user can specify the name of the contents 

of a control . Therefore, a rhythm dictionary table which employs 
the name of the contents of a control which is easy for the user 

20 to remember, is constructed. Further, the user can register a 
rhythm pattern without being aware of a rule between a word and 
a rhythm. 

[0046] Further, the rhythm pattern edition means may edit 

the registered contents of the rhythm dictionary table while 
25 confirming duplication of the registered rhythm pattern. 
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[0047] Further, in the rhythm dictionary table, the contents 

of the control may be defined in a hierarchical structure, 

the apparatus control means may memorize a hierarchical layer 
currently searched, and searchmatching of the input rhythm pattern 
5 and the registered rhythm pattern in the currently searched 
hierarchical layer, and 

the rhythm input section may further comprise a hierarchical 
layer switching means for causing the apparatus control means to 
switch the currently searched hierarchical layer. 

10 [0048] Thereby, the control system defines the contents of 

a control in a hierarchical structure . Therefore, even when there 
are a limited number of registered rhythm patterns , a larger number 
of the control contents can be defined as compared to a single-layer 
structure. Further, by defining the contents of a control in a 

15 hierarchical structure, the user can easily understand the contents 
of a control. 

[0049] In this case, the rhythm input section may comprise 

two or more input devices for inputting a tap by the user, and 
the hierarchical layer switching means may cause the 

20 apparatus control means to switch the currently searched 
hierarchical layer when the input device to be tapped is switched. 
[0050] Thereby, the user can switch the hierarchical 

structure only by switching an input device to be tapped . Therefore, 
a control system which can be simply operated is provided. 

25 [0051] Preferably, a user-specific registered rhythm 



pattern may be defined in the rhythm dictionary table, and 

the apparatus control means may search for a matching 
registered rhythm pattern for each user. 

[0052] Thereby, a registered rhythm pattern is defined for 

5 each user. Therefore, the control system can recognize an input 
rhythm pattern, taking into account each user's way of tapping. 
[0053] Preferably, the input rhythm pattern recognition 

means may memorize a parameter required for detection of the 
temporal change of the input rhythm signal, and analyze the input 

10 rhythm signal based on the parameter for each user. 

[0054] Thereby, a parameter is defined for each user. 

Therefore, the control system can recognize an input rhythm pattern, 
taking into account each user's way of tapping. 
[0055] Preferably, the control system may further comprise 

15 an output section of informing the user of a result of the search 
by the apparatus control means in terms of whether or not there 
is a matching registered rhythm pattern, using vibration, voice, 
visual sensation, or the like. 

[0056] Thereby, the user can know the success or failure of 

20 rhythm input, resulting in reassurance. 

[0057] Further, the control system may further comprise a 

sensation output section of causing the user to sense the rhythm 
pattern registered in the rhythm dictionary table in response to 
an instruction of the user. 

25 [0058] Thereby, the user can sense a registered rhythm pattern 
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via vibration, screen display, voice or the like, thereby making 
it possible to learn rhythm input . As a result, the user can acquire 
a registered rhythm pattern quickly. 

[0059] Preferably, when the amplitude of the input rhythm 

5 signal is at a LOW level for a predetermined time, the input rhythm 
pattern recognition means may recognize the input rhythm pattern 
assuming that the input is ended. 

[0060] Thereby, the control system can automatically 

recognize the end of inputting. Therefore, the user does not have 
10 to perform an operation for finishing inputting. 

[0061] For example, the control system may be mounted in a 

vehicle . 

[0062] In this case, the rhythm input section may be disposed 

on a steering wheel of the vehicle and has a structure which allows 

15 confirmation of a position by the sense of touch. 

[0063] A second aspect of the present invention is directed 

to a method for controlling an operation of at least one apparatus 
using a computer apparatus, comprising the steps: 

the computer apparatus analyzes an electrical signal input 

20 to the computer apparatus to recognize an input rhythm pattern; 

the computer apparatus references a rhythm dictionary table 
for associating the contents of a control of the apparatus with 
a registered rhythm pattern typifying a pronunciation pattern of 
a name indicating the contents of the control of the apparatus, 

25 the rhythm dictionary table being stored in the computer apparatus, 
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to search for a registered rhythm pattern matching the recognized 
input rhythm pattern; and 

the computer apparatus controls the apparatus based on the 
contents of the control corresponding to the registered rhythm 
5 pattern. 

[0064] A third aspect of the present invention is directed 

to a program for controlling an operation of at least one piece 
of software using a computer apparatus, comprising the steps: 
the computer apparatus analyzes an electrical signal input 

10 to the computer apparatus to recognize an input rhythm pattern; 

the computer apparatus references a rhythm dictionary table 
for associating the contents of a control of the apparatus with 
a registered rhythm pattern typifying a pronunciation pattern of 
a name indicating the contents of the control of the apparatus, 

15 the rhythm dictionary table being stored in the computer apparatus, 
to search for a registered rhythm pattern matching the recognized 
input rhythm pattern; and 

the computer apparatus controls the apparatus based on the 
contents of the control corresponding to the registered rhythm 

20 pattern. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0065] FIG . 1 is a diagram showing a structure of a control 

system 100 according to a first embodiment of the present invention 
25 and a whole structure of a system to which the control system 100 
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is applied; 

FIG. 2 is a diagram schematically showing an exemplary 
position in a vehicle where the rhythm input section 101 is mounted; 
FIG. 3 is a diagram schematically showing a waveform of an 
5 input rhythm signal when a digital input device is used as the 
rhythm input section 101; 

FIG. 4 is a diagram showing an exemplary rule table; 
FIG. 5 is a diagram showing an exemplary rhythm dictionary 

table; 

10 FIG. 6 is a flowchart showing an operation of a control 

section 102 when recognizing a rhythm input by the user tapping 
the rhythm input section 101 and controls an operation of an 
in-vehicle apparatus ; 

FIG. 7 is a flowchart showing a detailed operation of the 

15 control section 102 in an input rhythm pattern recognition process 
(step S102) ; 

FIG. 8 is a diagram showing a waveform of an input rhythm 
signal where an input device is used which continues to output 
an input rhythm signal having a HIGH level when pressed 
20 continuously; 

FIG. 9 is a diagram schematically showing a waveform of an 
input rhythm signal where an analog input device is used as the 
rhythm input section 101; 

FIG. 10 is a diagram schematically showing a waveform of 
25 an input rhythm signal output from a rhythm input section 101 in 
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a second embodiment; 

FIG. 11 is a diagram showing an exemplary rule table in the 
second embodiment; 

FIG. 12 is a diagram showing an exemplary rhythm dictionary 
5 table in the second embodiment; 

FIG. 13 is a flowchart showing a detailed operation of a 
control section 102 of the second embodiment in an input rhythm 
pattern recognition process; 

FIG. 14 is a flowchart showing a detailed operation of a 
10 control section 102 of a third embodiment in an input rhythm pattern 
recognition process; 

FIG. 15 is a diagram showing an example of an array Ti of 
tap interval timoo time intervals m emorized in step S401; 

FIG. 16 is a diagram showing an exemplary time distribution 
15 when a rhythm pattern assumed in step S405 is not appropriate; 

FIG. 17 is a diagram showing an exemplary time distribution 
when a rhythm pattern assumed in step S405 is appropriate; 

FIG. 18 is a flowchart showing a detailed operation of a 
control section 102 of a fourth embodiment in an input rhythm 
20 pattern recognition process; 

FIG. 19 is a flowchart showing a detailed operation of a 
control section 102 of a fifth embodiment in an input rhythmpattern 
recognition process ; 

FIG. 20 is a diagram showing a whole structure of a control 
25 system 600 according to a sixth embodiment of the present invention 
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and a system to which the control system 600 is applied; 

FIG. 21 is a flowchart showing an operation of a control 
section 602 in which a control section 102 recognizes a rhythm 
input by the user tapping a rhythm input section 101 to control 
5 an operation of an in-vehicle apparatus; 

FIG. 22 is a flowchart showing an operation of the control 
section 602 when the user confirms/edits the contents of a rhythm 
dictionary table; 

FIG. 23 is a diagram schematically showing a position in 
10 a vehicle of a rhythm input section 101 according to a seventh 
embodiment where the rhythm input section 101 is an analog input 
device composed of a piezoelectric sensor; 

FIG. 24 is a diagram showing an exemplary rhythm dictionary 
table stored in a rhythm dictionary storage section 103; and 
15 FIG. 25 is a flowchart showing a detailed operation of a 

control section 102 in a rhythm pattern recognition process. 



BEST MODE FOR CARRYING OUT THE INVENTION 
[0066] Hereinafter, embodiments of the present invention 

20 will be described with reference to the accompanying drawings. 
[0067] Firstly, an outline of each embodiment will be 

described. 

[0068] In a first embodiment, a system which determines 

whether or not a rhythm pattern matching a rhythm pattern input 
25 by the user is registered in a rhythm dictionary, and when there 

20 
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is a matching rhythm pattern, controls an operation of various 
apparatuses, will be described. 

[0069] In a second embodiment, a system which recognizes an 

intensity of an input rhythm pattern, determines whether or not 
5 a matching rhythm pattern is registered in a rhythm dictionary, 
and when there is a matching rhythm pattern, controls an operation 
of various apparatuses, will be described. 

[0070] In a third embodiment, a control system which searches 

all possible assumed rhythm patterns for a rhythm pattern closest 
10 to an input rhythm pattern, will be described. 

[0071] In a fourth embodiment, a control system which 

recognizes an input rhythm pattern by relative evaluation, will 
be described. 

[0072] In a fifth embodiment, a control system obtained by 

15 adding a function of recognizing an intensity of a rhythm pattern 
to the control system of the third and fourth embodiments, will 
be described. 

[0073] In a sixth embodiment, a control system which can 

switch parameters required for recognition of a rhythm pattern, 

20 depending on the user, will be described. Also, a control system 
which can edit a rhythm dictionary will be described. 
[0074] In a seventh embodiment, a control system which allows 

operations of multiple functions using a 

hierarchically-constructed rhythm dictionary, will be described. 

25 [0075] Hereinafter, each embodiment will be described in 
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detail . 

( First Embodiment ) 
[0076] FIG. 1 is a diagram showing a structure of a control 

system 100 according to the first embodiment of the present 
5 invention and a whole structure of a system to which the control 
system 100 is applied. In this embodiment , for the sake of 
simplicity, the control system 100 is assumed to be a system for 
controlling in-vehicle apparatuses, such as an air conditioner, 
an audio player and the like. 

10 [0077] In FIG. 1, the whole system comprises the control 

system 100, an air conditioner 201, an audio player 202, a 
television 203, and a car navigation system 204. The air 
conditioner 201, the audio player 202, the television 203 and the 
car navigation system 204 are apparatuses mounted in a vehicle 

15 (hereinafter referred to as in-vehicle apparatuses) . In-vehicle 
apparatuses described herein are for illustrative purpose only. 
In-vehicle apparatuses other than those of FIG . 1 may be included 
in the system. Alternatively, only a portion of the in-vehicle 
apparatuses of FIG. 1 may be included in the system. 

20 [0078] The control system 100 includes a rhythm input 

section 101, a control section 102 , and a rhythmdictionary storage 
section 103. 

[0079] To cause an in-vehicle apparatus to execute a certain 

function, the user strikes the rhythm input section 101 with 
25 several light blows in a manner which corresponds to a pronunciation 

22 



pattern of the name of the function (a rhythm produced by uttering 
the name of the function) . Hereinafter, to strike the rhythm input 
section 101 with several light blows is referred to as "tap the 
rhythm input section 101", and to input by tapping is referred 
5 to as "tap input". The rhythm input section 101 outputs an 
electrical signal whose amplitude level varies depending on the 
tap input (hereinafter referred to as an input rhythm signal) . 
The control section 102 receives the input rhythm signal output 
from the rhythm input section 101 and analyzes a time distribution 

10 of the amplitude level of the input rhythm signal to recognize 
a rhythmpattern which is intended by the user (hereinafter referred 
to as an input rhythmpattern) . The control section 102 searches 
the rhythm dictionary storage section 103 to determine whether 
or not a rhythm pattern matching the input rhythm pattern thus 

15 recognized is registered in the rhythm dictionary storage 
section 103. When a matching rhythmpattern is registered in the 
rhythm dictionary storage section 103, the control section 102 
recognizes the contents of a control corresponding to the rhythm 
pattern and controls an operation of an in-vehicle apparatus 

20 corresponds to the contents of the control. 

[0080] The rhythm input section 101 is composed of a digital 

input device, such as a touch pad, a contact switch or the like. 
The rhythm input section 101 supplies an input rhythm signal which 
is output depending on a tap input by the user, to the control 

25 section 102. 



[0081] FIG. 2 isa diagram schematically showing an exemplary 

position in a vehicle where the rhythm input section 101 is mounted. 
The rhythm input section 101 is provided on an upper portion of 
a steering wheel 3 01 for ease of tapping by the driver while driving . 
5 The rhythm input section 101 comprises a contact switch 302 and 
a projection 303 which is provided at a position where the contact 
switch 302 responds. The projection 303 has a structure which 
projects from the steering wheel 301 so that it is easy to find 
a place to be tapped even by groping. Note that the projection 303 
10 may have a concave structure if the position of the structure can 
be confirmed by the sense of touch. 

[0082] FIG. 3 is a diagram schematically showing a waveform 

of an input rhythm signal when a digital input device is used as 
the rhythm input section 101 . Since the rhythm input section 101 

15 is a digital input device, a rectangular pulse which goes from 
a silent beat level (LOW level) to a beat level (HIGH level) in 
association with tapping by the user, as shown in FIG. 3. In the 
first embodiment, a timing of rising of the pulse is referred to 
as a key-down timing time , while a timing of falling of the pulse 

20 is referred to as a key-up timing time . A time between adjacent 
key-down timings times is referred to as a tap interval time time 
interval . 

[0083] The rhythm dictionary storage section 103 is a memory 

device, such as a RAM, a ROM, a hard disk or the like. The rhythm 
25 dictionary storage section 103 stores a rhythm dictionary for 
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associating the contents of controls of in-vehicle apparatuses 
with rhythmpatterns . The rhythmdictionary comprises a rule table 
which defines a rule for typifying the name of the contents of 
a control, and a rhythm dictionary table for associating the names 
5 of the contents of controls with rhythm patterns . 

[0084] Here, the term "rhythm pattern" used herein will be 

described. When uttering a word, the user utters the word with 
a predetermined rhythm. For example, the pronunciation of one 
word may include a long sound, a short sound, a strong sound, and/or 

10 a weak sound. This flow of sounds can be referred to as a 
pronunciation pattern. The rhythm pattern refers to a pattern 
which typifies the pronunciation pattern. Note that the 
pronunciation pattern can be referred to as a voice pattern. 
[0085] FIG. 4 is a diagram showing an example of the rule 

15 table. This rule table shows a correspondence between mora units 
of the Japanese language and unit rhythm patterns. Here, a unit 
rhythm pattern is composed of simple codes which represent the 
timing of tapping (beat) and the timing of not tapping (silent 
beat), for each mora unit. Here, "x" and are used as codes. 

20 "x" represents a beat. represents a silent beat. 

[0086] Moras are divided into six: syllabic nasals (e.g., 

" h (n) " in the Japanese language, etc. ) ; geminate consonants (e.g., 
"o (tsu) " in the Japanese language, etc. ) ; palatal consonants (e.g., 
xx cF (kya) ", "^$>(kyu)", "#£(kyo)" in the Japanese language, 

25 etc. ) ; prolonged sounds (e.g., (a) ", "f"t— (ke) " in the Japanese 



language, etc); diphthongs (e.g., "£>&(aa)", "folMai)", 
(ei)" in the Japanese language, etc.); and other sounds (e.g., 
only a vowel, a vowel + a consonant, etc., hereinafter referred 
to as general sounds) . The syllabic nasal and the geminate 
5 consonant are unvoiced sounds. The palatal consonant and the 
general sound are voiced sounds. The prolonged sound and the 
diphthong include voiced sounds and unvoiced sounds. 
[0087] As shown in FIG - 4, each syllabic nasal is assigned 

the unit rhythm pattern Each geminate consonant is assigned 

10 the unit rhythm pattern Each palatal consonant is assigned 

the unit rhythm pattern "x". Each prolonged sound is assigned 
a unit rhythm pattern "x-", Each diphthong is assigned the unit 
rhythmpattern "x-" . Each general sound is assigned the unit rhythm 
pattern xx x". 

15 [0088] FIG. 5 is a diagram showing an example of the rhythm 

dictionary table. This rhythm dictionary table shows a 
correspondence between the names of the contents of controls of 
in-vehicle apparatuses and rhythm patterns. Hereinafter, a 
rhythm pattern registered in a rhythm dictionary table is referred 

20 to as a registered rhythm pattern. The names of the contents of 
controls of in-vehicle apparatuses indicate the names of functions 
of the in-vehicle apparatuses to be activated. Here, for the 
purpose of easy understanding by the user, the name of the contents 
of a control is defined as "ifelH (chizu) " (map) in order to display 

25 a map, or the contents of a control is defined as (denwa) " 
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(telephone) in order to activate a telephone, for example. In 
this manner, more instinctive names of the contents of controls 
are used, but the rule for determining the names of the contents 
of controls are not limited to this . A registered rhythm pattern 
5 is defined by typifying the pronunciation pattern of the name of 
the contents of a corresponding control (a rhythm produced by 
uttering the name of the contents of the corresponding control) . 
In the first embodiment, a registered rhythm pattern is defined 
by dividing the name of the contents of a control into mora units, 
10 and assigning each divided unit a corresponding unit rhythm 
pattern . 

[0089] For example, the Japanese word "i&IH (chizu) " (map) 

is decomposed into mora units u ^(chi)" and VN f (zu) w . "^(chi)" 
and (zu)" are each a general sound. Therefore, a registered 
15 rhythmpattern corresponding to the name of the contents of a control 

"iftEl (chizu) " (map) is u xx ,/ . 

[0090] A Japanese word " HIS (denwa)" (telephone) is 

decomposed into moras "T(de)", w Mn) " and "fr(wa)". w T?(de) w 
is a general sound, "A/(n)" is a syllabic nasal, and "fa(wa)" is 
20 a general sound. Therefore, a registered rhythm pattern 
corresponding to the name of the contents of a control "fts§ (denwa) " 

(telephone) is "x-x". 

[0091] A Japanese word "^T 3 y (eakon) " (air conditioner) 

is decomposed into moras *£(e)", xy fo(a)", "^(ko)" and "Mn)". 
25 "X.(e)", "fo(a)" and " r. (ko)" are general sounds, and "/v(n)" is 



a syllabic nasal. The syllabic nasal is a silent beat and "A/ 
(n)" is the last sound. Therefore, a registered rhythm pattern 
corresponding to the name of the contents of a control u ^7^ 
>(eakon)" (air conditioner) is "xxx". 
5 [0092] A Japanese word "^.itlx^ (ondosette ) " (temperature 

setting) is decomposed into moras ^Mo)", "/v(n)", w ^(do)", "it" 
(se)", "o(t)", and "T— (te)". u Ay(n)" is a syllabic nasal, "o 
(t)" is a geminate consonant, and "T^tte)" is a prolonged sound 
and a last sound. Therefore, a registered rhythm pattern 
10 corresponding to the name of the contents of a control "filSfx 
At: (ondosette) " (temperature setting) is "x-xx-x". 
[0093] A Japanese word W >J"— (odhio) " (audio player) is 

decomposed into moras "*5— (6)", "TvMdhi)" and ^Mo)". 
(6) " is a prolonged sound . Therefore, a registered rhythm pattern 

15 corresponding to the name of the contents of a control — X 
4 Jr (odhio) " (audio player) is "x-xx". 

[0094] As described above, a registered rhythm pattern is 

defined by dividing the name of the contents of a control into 
one or more mora units and assigning unit rhythm patterns to the 

20 mora units . This method of defining a rhythm pattern using divided 
mora units is suitable for languages, such as the Japanese language, 
in which words are pronounciated without taking care of accents. 
For example, when the word "±tii(2] (chizu) " (map) is uttered, the 
beats are "tomtom" . The beats are not changed no matter whether 

25 "£>(chi)" or "T" has an accent. When the word "fltfg (denwa) " 



(telephone) is uttered, the beats are "tom-tom" where a rest is 
present between two beats. The beats are not changed no matter 
whether NX "C(de)" or "fo(wa)" has an accent. The same is true of 
the other examples. 
5 [0095] The control section 102 is composed of a CPU, a memory 

and the like . The control section 102 simplifies a temporal change 
in an amplitude level of an input rhythm signal input from the 
rhythm input section 101 to recognize an input rhythm pattern. 
This recognition method will be described elsewhere below (see 

10 FIG. 7). The control section 102 determines whether or not there 
is a registered rhythm pattern which matches the recognized input 
rhythm pattern, with reference to the rhythm dictionary table 
stored in the rhythm dictionary storage section 103. When there 
is a matching registered rhythm pattern, the control section 102 

15 recognizes the name of the contents of a control corresponding 
to the registered rhythm pattern and controls an operation of an 
in-vehicle apparatus which performs the contents of the control. 
[0096] FIG. 6 is a flowchart showing an operation of the 

control section 102 when recognizing a rhythm input by the user 

20 tapping the rhythm input section 101 and controls an operation 
of an in-vehicle apparatus. Hereinafter, the operation of the 
control section 102 will be described with reference to FIG. 6. 
[0097] Firstly, the control section 102 determines whether 

or not there is an input by the user, depending on whether or not 

25 an input rhythm signal is received from the rhythm input section 101 
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(step S101) . When there is no input by the user, the control 
section 102 ends the process. On the other hand, when there is 
an input by the user, the control section 102 analyzes an input 
rhythm signal from the rhythm input section 101 to recognize an 
5 input rhythm pattern (step S102) . The process for recognition 
of an input rhythm pattern will be described elsewhere below (see 
FIG. 7) . 

[0098] Next, the control section 102 references the rhythm 

dictionary table in the rhythm dictionary storage section 103 

10 (step S103) , and determines whether or not a registered rhythm 
pattern which matches the recognized input rhythm pattern is 
registered in the rhythm dictionary table (step S104) . 
[0099] When there is no matching registered rhythm pattern, 

the control section 102 ends the process . On the other hand, when 

15 there is a matching registered rhythm pattern, the control 
section 102 instructs an in-vehicle apparatus to perform the 
contents of a control corresponding to the registered rhythm 
pattern (step S105) , and ends the process. 

[0100] FIG. 7 is a flowchart showing a detailed operation 

20 of the control section 102 in the input rhythm pattern recognition 
process (step S102) . Hereinafter, the operation of the control 
section 102 in the input rhythm pattern recognition process will 
be described with reference to FIG. 7. 

[0101] Firstly, the control section 102 sets a head pattern 

25 as "x" (step S201) . This setting is for detection of an interval 



time a time interval between the head and the next tap. 
[0102] Next, the control section 102 determines whether or 

not the rhythm input section 101 is tapped within a predetermined 
end interval time time interval (step S202) . Specifically, the 
5 control section 102 performs the determination based on whether 
or not there is a pulse which reaches the beat level within the 
end interval time time interval . Here, the end interval time time 
interval refers to a threshold time such that when there is no 
user input during this time or more, the user is considered to 

10 finish inputting a rhythm. For example, the end interval time 
time interval is predetermined to be 600 milliseconds or the like. 
[0103] When the next tap is input within the end interval 

time time interval , the control section 102 determines whether 
or not the tap interval time time interval exceeds a predetermined 

15 prolonged sound interval time time interval (step S203) . Here, 
the prolonged sound interval — time time interval refers to a 
threshold for determining whether a tap having the elapsed tap 
interval time time interval has one beat and one silent beat (two 
beats) or only one beat . For example, the prolonged sound interval 

20 time time interval is predetermined to be 400 milliseconds. 

[0104] When the tap interval time time interval does riot 

exceed the prolonged sound interval time time interval , the control 
section 102 determines the next pattern as "x" (step S204) and 
returns to the operation of step S202. On the other hand, when 

25 the tap interval time time interval exceeds the prolonged sound 
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interval time time interval , the control section 102 determines 
that the next pattern is "-x" (step S205) , and returns to the 
operation of step S202. 

[0105] On the other hand, in step S202, when no next tap is 

5 input within the end interval time time interval , the control 
section 102 determines that the user finishes inputting, and 
recognizes a final input rhythm pattern in accordance with the 
pattern determined in steps S201, S204 and S205, and returns to 
the main operation of FIG. 6. 

10 [0106] As described above, in the control system of the first 

embodiment, an input rhythm signal is output from the rhythm input 
section, corresponding to tapping by the user . The control section 
analyzes a temporal change in the amplitude of the input rhythm 
signal and simplifies the temporal change into the timing of a 

15 beat and the timing of a silent beat to recognize an input rhythm 
pattern. The control section determines whether or not a 
registered rhythmpattern whichmatches the recognized input rhythm 
pattern is registered in a rhythm dictionary table. When there 
is a matching registered rhythm pattern, the control section 

20 performs the contents of a corresponding control. Therefore, it 
is possible to provide a control system in which a small number 
of input devices are used to input an operation instruction without 
being affected by surrounding noise or the like, which interrupts 
speech recognition, and the contents of the operation instruction 

25 is reliably recognized so that operations of various apparatuses 
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can be controlled by blind touch. 

[0107] For example, there are not more than twenty to thirty 

kinds of contents of controls for operating in-vehicle apparatuses . 
Such a small number of contents of controls can be expected to 
5 be all represented by rhythm patterns . Therefore, it is possible 
to provide a control system which can perform reliably minimally 
required operations using a small number of input devices. 
[0108] Further, in the first embodiment , a registered rhythm 

pattern is associated with a rhythm produced by uttering the name 

10 of the contents of a corresponding control. The contents of a 
control instinctively match a rhythm pattern. Therefore, it can 
be expected that rhythm patterns can be more easily input. 
[0109] Further, in the first embodiment, when receiving a 

rhythm input by the user, the control system recognizes that there 

15 is an operation instructionby the user (seestep S101) . Therefore, 
it is no longer necessary for the user to switch the mode of a 
control system into a speech recognitionmode, which is a burdensome 
operation required by speech recognition systems. 
[0110] Further, in the first embodiment, a rhythm pattern 

2 0 can be determined only by comparing a tap interval time time interval 
with the end interval time time interval and the prolonged sound 
interval time time interval . Therefore, a considerably simple 
algorithm can be used to recognize a rhythm pattern. Therefore, 
advantageously, the implementation is easy, and the sizes of a 

25 program and a memory which are consumed are considerably small. 
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[0111] Note that the registered names of the contents of 

controls are Japanese words in the above-described embodiment, 
and may be words of any language, such as English, German, French, 
Russian, Spanish, Chinese, Korean or the like. In these cases, 
5 rhythm patterns which typify pronunciation patterns produced by 
uttering the names of the contents of controls are registered as 
registered rhythm patterns. 

[0112] Note that the end interval time time interval and the 

prolonged sound interval time time interval m ay be adjusted by 

10 initial setting by the user. Thereby, it is possible to absorb 
differences among individuals including a user having a high input 
speed and a user having a low input speed. For initial setting, 
the user may input a typical pattern, and thereafter, the control 
system may recognize automatically an end interval and a prolonged 

15 sound interval. 

[0113] Note that a digital input device which continues to 

output an input rhythm signal having the HIGH level when pressed 
continuously may be used as a rhythm input section. FIG. 8 is 
a diagram showing a waveform of an input rhythm signal when this 

20 input device is used. As shown in FIG. 8, a time for which a beat 
level is attained varies depending on a time for which the rhythm 
input section is pressed. By pressing the rhythm input section 
continuously, the user can input a rhythm composed of a voiced 
sound and an unvoiced sound, such as an input prolonged sound, 

25 diphthong or the like. When an input rhythm pattern keeps the 



HIGH level for a predetermined interval time time interval or more, 
the control section recognizes that the input rhythm pattern has 
a voiced sound and an unvoiced sound, i.e., a beat and a silent 
beat. Thereafter, the control section determines the matching 
5 of the input rhythm pattern and a registered rhythm pattern and 
controls an operation of an in-vehicle apparatus as in the 
above-described embodiment . 

[0114] Although a digital input device is used as the rhythm 

input section 101 in the first embodiment, an analog input device, 

10 such as a piezoelectric sensor or the like, may be used. FIG. 9 
is a diagram schematically showing a waveform of an input rhythm 
signal when an analog input device is used as the rhythm input 
section 101. When an analog input device is used as the rhythm 
input section 101, a beat level is predetermined . Since the rhythm 

15 input section 101 is an analog input device, an intensity level 
of the amplitude of an output signal thereof varies depending on 
tapping by the user as shown in FIG. 9. Here, a time at which 
the amplitude level of the waveform which exceeds the beat level 
and has a peak is referred to as a key-down timing time . Also, 

20 a time at which the amplitude level is lowest after the key-down 
timing time is referred to as a key-up timing time . A time between 
adjacent key-down timings times is referred to as a tap interval 
time time interval . By defining the tap interval time time interval 
in this manner, the control section can recognize a rhythm pattern 

25 in a manner similar to the rhythm pattern recognition of FIG. 7. 

35 



( Second Embodiment ) 
[0115] A whole structure of a system according to a second 

embodiment of the present invention is similar to that of the first 
embodiment, and therefore, FIG. 1 is referenced in the second 
5 embodiment. Hereinafter, a difference between the first 
embodiment and the second embodiment will be mainly described. 
[0116] In the second embodiment , the rhythm input section 101 

is composed of an analog input device, such as a piezoelectric 
sensor or the like. 

10 [0117] FIG. 10 is a diagram schematically showing a waveform 

of an input rhythm signal output from the rhythm input section 101 
in the second embodiment. In the second embodiment, a strong beat 
level and a weak beat level are predetermined. Since the rhythm 
input section 101 is an analog input device, an amplitude level 

15 of an output signal thereof varies depending on tapping by the 
user as shown in FIG. 10. In the second embodiment, a time at 
which an amplitude level of the waveform which exceeds the strong 
or weak beat level and has a peak is referred to as a key-down 
timing time . Also, a time at which the amplitude level is lowest 

20 after the key-down timing time is referred to as a key-up timing 
time . A time between adjacent key-down timings times is referred 
to as a tap interval time time interval . 

[0118] In FIG . 10, when the amplitude level of an input rhythm 

signal exceeds the weak beat level, it is determined that a beat 
25 has occurred. When the amplitude level of an input rhythm signal 
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is between the weak beat level and the strong beat level, it is 
determined that a weak beat has occurred . When the amplitude level 
of an input rhythm signal exceeds the strong beat level, it is 
determined that a strong beat has occurred. 
5 [0119] In the second embodiment, a rhythm dictionary 

comprises a rule table which defines units for patterning the names 
of the contents of controls and a rhythm dictionary table for 
associating the names of the contents of controls with registered 
rhythm patterns. 

10 [0120] FIG. 11 is a diagram showing an example of the rule 

table. In the rule table, syllabic units of the English language 
are associated with unit rhythm patterns . Syllables are divided 
into six groups: accented syllables, unaccented syllables, 
accented prolonged syllables, unaccented prolonged syllables, 

15 accented diphthongs, and unaccented diphthongs. 

[0121] In FIG. 11, a strong beat is represented by "A", a 

weak beat is represented by "x" , and a silent beat is represented 
by As shown in FIG. 11, an accented syllable is assigned 

a unit rhythm pattern "A". An unaccented syllable is assigned 

20 a unit rhythm pattern "x" . An accented prolonged syllable is 
assigned a unit rhythm pattern "A-". An unaccented prolonged 
syllable is assigned a unit rhythm pattern "x-". An accented 
diphthong is assigned a unit rhythm pattern "A-". An unaccented 
diphthong is assigned a unit rhythm pattern "x-". 

25 [0122] FIG. 12 is a diagram showing an example of the rhythm 



dictionary table. A registered rhythm pattern is defined by 
decomposing the name of the contents of a control into syllabic 
units and assigning the divided syllabic units respective 
corresponding unit rhythm pat terns . Here, the name of the contents 
5 of a control is decomposed into syllabic units based on the phonetic 
symbols thereof. 

[0123] For example, an English word "navigation" is 

decomposed into syllabic units : xv na", "vi", "ga" and "tion" . "na" 
and w vi" are unaccented syllables . "ga" is an accented diphthong . 

10 "tion" is an unaccented syllable. Therefore, a registered rhythm 
pattern which corresponds to the name of the contents of a control 
"navigation" is NN xxA-x" . For the names of the contents of other 
controls, registered rhythm patterns are defined similarly. 
[0124] Next, an operation of the control section 102 of the 

15 second embodiment will be described. A main operation of the 
control section 102 when a rhythm is input by the user is similar 
to that of the first embodiment , and therefore, FIG. 6 is referenced 
The second embodiment is different from the first embodiment in 
the input rhythm pattern recognition process. 

20 [0125] FIG. 13 is a flowchart showing a detailed operation 

of the control section 102 of the second embodiment in the input 
rhythm pattern recognition process. Hereinafter, the operation 
of the control section 102 in the input rhythm pattern recognition 
process will be described with reference to FIG. 13. 

25 [0126] Firstly, the control section 102 determines whether 



a first amplitude peak of an input rhythm signal is a strong beat 
or a weak beat (step S301) . When the first amplitude peak is a 
strong beat, the control section 102 sets a head pattern as "A" 
(step S302) , and goes to an operation of step S304 . On the other 
5 hand, when the first amplitude peak is a weak beat, the control 
section 102 sets a head pattern as "x" (step S303) , and goes to 
the operation of step S304. 

[0127] In step S304, the control section 102 determines 

whether or not the rhythm input section 101 is tapped within a 

10 predetermined end interval — time — time interval (step S305) . 
Specifically, the control section 102 determines whether or not 
an electrical signal which exceeds the weak beat level is input 
within the end interval timo time interval . The end interval time 
time interval is similar to that of the first embodiment. 

15 [0128] In step S304, when the next tap is not input within 

the end interval — time time interval , the control section 102 
determines that the user finishes inputting, and returns to the 
main operation of FIG. 6. 

[0129] On the other hand, when the next tap is input within 

20 the end interval — time time interval , the control section 102 
determines whether or not the tap interval time time interval 
exceeds a predeterminedprolonged sound interval time time interval 
(step S305) . The prolonged sound interval time time interval is 
similar to the first embodiment. 
25 [0130] When the tap interval time time interval does not 
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exceed the prolonged sound interval time time interval , the control 
section 105 determines whether or not a peak of the amplitude level 
of the input rhythm signal at a key-down timing time is a strong 
beat or a weak beat (step S306) . When the peak is a strong beat, 
5 the control section 105 102 determines the next pattern as "A" 
(step S307), and returns to the operation of step S304. On the 
other hand, when the peak is a weak beat, the control section -3r&£ 
102 determines the next pattern as "x" (step S308), and returns 
to the operation of step S304. 

10 [0131] On the other hand, when the tap interval time time 

interval exceeds the prolonged sound interval time time interval 
in step S305, the control section 105 102 determines a peak of 
the amplitude level of the input rhythm signal at the key-down 
timing time is a strong beat or a weak beat (step S309) . When 

15 the peak is a strong beat, the control section 105 102 determines 
the next pattern as "-A" (step S310) , and returns to the operation 
of step S304. On the other hand, when the peak is a weak beat, 
the control section 105 102 determines the next pattern as w -x" 
(step S311), and returns to the operation of step S304. 

20 [0132] As described above, in the second embodiment, to 

support a language with an accent, such as English or the like, 
the control system employs an analog input device to determine 
the intensity of a tap, and determines matching of a rhythm pattern 
with reference to a rhythmdictionary which defines rhythm patterns 

25 using syllables and accents. Therefore, also in languages, such 
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as English and the like, it is possible to provide a control system 
in which a small number of input devices are used to input an 
operation instruction without being affected by surrounding noise 
or the like, which interrupts speech recognition, and the contents 
5 of the operation instruction are reliably recognized so that 
operations of various apparatuses can be controlled by blind touch . 
[0133] Note that, in the control system, the name of the 

contents of a control in the Japanese language may be decomposed 
into syllables to define a rhythm dictionary, which is used to 
10 recognize matching of a rhythm pattern. In this case, the position 
of an accent may, or may not, be determined. 

[0134] Note that a method of recognizing a rhythm pattern 

is not limited to the above-described recognition method. The 
tap interval time time interval m ay be defined as a time between 

15 adjacent key-up timingo times . Further, the intensity of an 
amplitude may be defined more finely (stepwise) instead of two 
levels (strong and weak) . 

(Third Embodiment) 
[0135] A whole structure of a system according to a third 

20 embodiment of the present invention is similar to that of the first 
embodiment, and therefore, FIG. 1 is referenced in the third 
embodiment. In the third embodiment , the rhythm input section 101 
may be either a digital input device or an analog input device. 
[0136] Hereinafter, an operation of a control section 102 

25 of the third embodiment will be described. A main operation of 
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the control section 102 when a rhythm is input by the user is similar 
to that of the first embodiment , and therefore, FIG. 6 is referenced . 
The third embodiment is different from the first embodiment in 
the input rhythm pattern recognition process. 
5 [0137] FIG. 14 is a flowchart showing a detailed operation 

of the control section 102 of the third embodiment in the input 
rhythm pattern recognition process. Hereinafter, the operation 
of the control section 102 in the input rhythm pattern recognition 
process will be described with reference to FIG. 14. 

10 [0138] Firstly, when receiving an input rhythm signal from 

the rhythm input section 101, the control section 102 measures 
and memorizes a key-down timing time , and measures and memorizes 
an elapsed time from the previous key-down timing time ( tap interval 
time time interval ) (step S401) . Here, when a key-down timing 

15 time occurs for the first time, the control section 102 cannot 
measure a tap interval time time interval , and goes directly to 
the operation of step S401. The control section 102 is assumed 
to memorize tap interval timog time intervals as an array Ti . 
[0139] Next, the control section 102 determines whether or 

20 not the next tap is input within a predetermined end interval time 
time interval , based on an amplitude level of an input rhythm signal 
(step S402) . Specif ically, the control section 102 performs the 
determination based on whether or not a key-down timing time occurs 
within the end interval time time interval . Here, the end interval 

25 time time interval is similar to that of the first embodiment. 



[0140] When the next tap is input within the end interval 

time time interval , the control section 102 returns to the 
operation of step S401. On the other hand, when the next tap is 
not input within the end interval time time interval (i.e., the 
5 user finishes inputting a rhythm) , the operation of the control 
section 102 goes to step S403. 

[0141] In step S403, the control section 102 determines 

whether or not the number of times of occurrence of a key-down 
timing time (hereinafter referred to as the number of taps) is 

10 one, with reference to the information memorized in step S401. 
When the number of taps is one, the control section 102 determines 
that the input rhythm pattern is "x" (step S404), and returns to 
the main operation of FIG. 6. On the other hand, when the number 
of taps is not one, the control section 102 goes to the operation 

15 of step S405. 

[0142] Instep S405, the control section 102 assumes a rhythm 

pattern corresponding to the number of taps (step S405) . Here, 
a rhythm pattern within one tap interval time time interval is 
assumed to have only one beat (i.e., "x" ) or two beats (i.e., u x-" 

20 representing a beat and a silent beat) . The last pattern is 
inevitably "x" . Therefore, when the number of taps is N, the number 
of all possible rhythm patterns is 2 to the power of N-l. For 
example, when the number of taps is N=5, the number of all possible 
rhythm patterns is 2 to the power of 4, i.e., 16. 

25 [0143] Next, the control section 102 obtains a time 



distribution of the assumed rhythm pattern, and calculates how 
much an actually measured tap interval time time interval is 
deviated from the obtained time distribution (step S406) . A 
process in step S406 will be described in detail with reference 
5 to FIGS . 15 to 17. 

[0144] FIG. 15 is a diagram showing an example of the array Ti 

of tap interval timco time intervals m emorized in step S401. In 
the example of FIG. 15, the tap interval time time interval array Ti 
registers actually measured tap interval times (ms) associated 

10 with tap numbers . Here, a tap number indicates the ordinal number 
of a tap. For example, a tap interval — time — time interval 
corresponding to a tap number "1" indicates a tap interval time 
time interval from a first key-down timing time of an input rhythm 
signal to the next key-down timing time . In other words, a tap 

15 interval — time time interval corresponding to each tap number 
indicates an elapsed time from the key-up timing time of a tap 
number to the key-down timing time of the next tap number. 
Therefore, there is no tap interval — time — time interval 
corresponding to the last tap number ("5" in FIG. 15). 

20 [0145] FIG. 16 is a diagram showing an example of the time 

distribution when the rhythm pattern assumed in step S405 is not 
appropriate. FIG. 17 is a diagram showing an example of the time 
distribution when the rhythm pattern assumed in step S405 is 
appropriate. Hereinafter, a method of obtaining the time 

25 distribution of the assumed rhythm pattern will be described with 



reference to FIGS. 16 and 17. 

[0146] Firstly, the control section 102 assumes one rhythm 

pattern. In FIG. 16, for example, "x-xxx-x" is assumed. Next, 
the control section 102 counts the number of beats of the assumed 
5 rhythm pattern for each tap number and calculates the total SXi . 
Here, the control section 102 counts u x" as one beat and "x-" as 

two beats . In the example of FIG. 16, the total ZXi of the number 
of beats of the assumed rhythm pattern is "6". 

[0147] Next, the control section 102 obtains a total ZTi of 

10 actual tap interval timco time intervals . In the example of FIG . 15, 
the total STi of actual tap interval times time intervals is "2100 
(ms) " . 

[0148] Next, the control section 102 divides the total STi 

of actual tap interval timco time intervals by the total S^i of 

15 the number of beats to obtain a value x. That is, x=STi/SXi. In 
the example of FIG. 16, x=2100/6=350 (ms) . The value x is a 
required time per beat in the assumed rhythm pattern . The control 
section 102 multiplies the value x by the number of beats of each 
tap number to obtain a tap interval time time interval for the 

20 tap number. In the example of FIG. 15, a tap interval time time 
interval assumed for the tap number "1" is 350 (ms)x2 = 700 (ms) . 
A tap interval time time interval assumed for the tap number "2" 

is 350 (ms)xl=350 (ms). 

[0149] Next, the control section 102 obtains a deviation (ms) 

25 between an actual tap interval time time interval and an assumed 



r. 



tap interval time time interval for each tap number . In the example 
of FIG. 15, an actual tap interval time time interval for the tap 
number "1" is 764 (ms) . In the example of FIG. 16, an assumed 
tap interval time time interval for the tap number "1" is 7 00 (ms) . 
5 Therefore, the deviation is +64 (ms) . 

[0150] Next, the control section 102 sums the absolute value 

of the deviation in each tap number (except for the last tap number) 
to obtain an average value a. That is, a=Z | Ti-x*^i | . In the 
example of FIG. 16, a= ( 64+39+334+359) /4=199 . In the example of 
10 FIG. 17, a= (64+3 9+16+9) /4=32. a is a value indicating a deviation 
of the distribution of actually measured tap interval timco time 
intervals from the distribution of tap interval — timco — time 

intervals in the assumed rhythm pattern. In other words, a is 
an index for the validity of the assumed rhythm pattern. The 

15 smaller the value a, the larger the validity of the assumed rhythm 
pattern. Hereinafter, a is referred to as a deviation index. 
[0151] When a rhythm pattern, such as that shown in FIG. 16, 

is assumed, the deviation index a is 119. On the other hand, when 
a rhythm pattern, such as that shown in FIG. 17, is assumed, the 

20 deviation index ais 32. Therefore, the rhythm pattern of FIG . 17 
is expected to be closer to a rhythm pattern actually input by 
the user than the rhythm pattern of FIG. 16. 

[0152] Referring back to FIG . 14, an operation of the control 

section 102 will be described. 
25 [0153] As described above, after obtaining a deviation index 
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between an actual tap interval time time interval and a tap interval 
time time interval based on an assumed rhythm pattern, the control 
section 102 determines whether or not the deviation index 
calculated in step S406 exceeds a minimum deviation index 
5 (step S407) . Here, the minimum deviation index refers to a 
smallest one of the deviation indexes of rhythm patterns which 
have been assumed up to the current time. 

[0154] When a deviation index does not exceed the minimum 

deviation index, the control section 102 memorizes this deviation 

10 index as a minimum deviation index, and memorizes a rhythm pattern 
having the deviation index as an expected rhythm pattern 
(step S408), and goes to an operation of step S409. Note that, 
when a rhythm pattern is initially assumed, the control section 102 
memorizes no minimum deviation index, and therefore, inevitably 

15 goes to the operation of step S408. 

[0155] On the other hand, when a deviation index exceeds the 

minimum deviation index, the control section 102 does not update 
the minimum deviation index, and returns to the operation of 
step S405 and another rhythm pattern is assumed. 

20 [0156] In step S409, the control section 102 determines 

whether or not all possible rhythm patterns have been assumed. 
When all possible rhythm patterns have not been assumed, the control 
section 102 returns to the operation of step S405 and assumes 
another rhythm pattern. By returning to the operation of step S4 05 

25 in this manner, the control section 102 obtains a rhythm pattern 
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having the minimum deviation index a among all possible assumed 
rhythm patterns. 

[0157] On the other hand, when all possible rhythm patterns 

have been assumed, the control section 102 determines whether or 
5 not an expected rhythm pattern having the minimum deviation index 
is an even rhythm pattern (step S410) . Here, the even rhythm 
pattern refers to a rhythm pattern which is composed of tap i nterval 
times time intervals each having the same number of beats, such 
as "xxx" , "x-x-x" or the like. 

10 [0158] When the expected rhythm pattern is not an even rhythm 

pattern, the control section 102 determines that the expected 
rhythm pattern is an input rhythm pattern recognized from an input 
rhythm signal and returns to the main operation of FIG. 6. 
Thereafter, the control section 102 determines matching of the 

15 input rhythm pattern and a registered rhythm pattern to control 
an operation of an in-vehicle apparatus. 

[0159] On the other hand, when the expected rhythm pattern 

is an even rhythmpattern, the control section 102 cannot determine 
whether an actual rhythm pattern is an even rhythm pattern composed 
20 of xx x" or "x-". This is because all even rhythm patterns have 
the same deviation index. 

[0160] Therefore, the control section 102 obtains an average 

value of tap interval times time intervals , and determines whether 
or not the average value is within a prolonged sound interval time 
25 time interval (step S411) . Here, the prolonged sound interval 



time time interval is similar to that of the first embodiment. 
[0161] When the average value of tap interval timco time 

intervals is within the prolonged sound interval time time interval , 
the control section 102 finally recognizes a rhythm pattern 
5 composed of only rhythms all having one beat (i.e., the beat "x") 
as an input rhythm pattern (step S412), and returns to the main 
operation of FIG. 6. 

[0162] On the other hand, when the average value of tap 

interval timco time intervals is greater than the prolonged sound 

10 interval — time time interval , the control section 102 finally 
recognizes a rhythm pattern composed of only rhythms all having 
two beats (i.e., a beat + a silent beat "x-", except that only 
the last rhythm is "x") as an input rhythm pattern (step S413), 
and returns to the main operation of FIG. 6. 

15 [0163] As described above, the control system assumes all 

possible rhythm patterns and compares a distribution of tap 
interval timeo time intervals in an actual input rhythm signal 
with a distribution of tap interval timco time intervals in the 
assumed rhythm pattern to obtain a deviation of the assumed rhythm 

20 pattern from the actual input rhythm signal. The control system 
recognizes one of the assumed rhythmpatterns which has the smallest 
deviation, as an input rhythm pattern. 

[0164] As described above, in the third embodiment, the 

control system recognizes an input rhythm pattern by considering 
25 a total sum of tap interval timco time intervals . Therefore, it 



is possible to recognize an input rhythm pattern by considering 
the whole rhythm thereof irrespective of the tempo thereof. 
Therefore, the control system can absorb differences among 
individual users to recognize an input rhythm pattern . Therefore, 
5 it is possible to control an operation of each apparatus more 
reliably as compared to when an input rhythm pattern is recognized 
by simply comparing a tap interval time time interval with a 
prolonged sound interval. 

[0165] Note that the end interval, and the prolonged sound 

10 interval for determining a final rhythm pattern in the case of 
an even rhythm pattern, may be adjusted by initial setting by the 
user . 

[0166] Although, in the third embodiment , all possible rhythm 

patterns are assumed from the number of taps, and a rhythm pattern 

15 which best matches a tendency of a temporal change in an actual 
input rhythm signal is recognized as an input rhythm pattern, a 
method of determining matching of the tendency of the temporal 
change is not limited to this. For example, the control section 
may search all registered rhythm patterns in the rhythm dictionary 

20 table for one which best matches the tendency of a temporal change 
in an actual input rhythm signal and recognize the best matching 
registered rhythm pattern as an input rhythm pattern. 
Alternatively, the control section may search only registered 
rhythm patterns having a matching number of taps for one which 

25 best matches the tendency of a temporal change in an actual input 
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rhythm signal and recognize the best matching registered rhythm 
pattern as an input rhythm pattern. Here, a method of examining 
the tendency of the temporal change may be a method of comparing 
deviation indexes as described above. 
5 (Fourth Embodiment) 

[0167] A whole structure of a system according to a fourth 

embodiment of the present invention is similar to that of the first 
embodiment, and therefore, FIG. 1 is referenced in the fourth 
embodiment. In the fourth embodiment, the rhythm input 
10 section 101 may be either a digital input device or an analog input 
device . 

[0168] Hereinafter, an operation of the control section 102 

of the fourth embodiment will be described. Amain operation of 
the control section 102 when a rhythm is input by the user is similar 
15 to that of the first embodiment , and therefore, FIG. 6 is referenced . 
The fourth embodiment is different from the first embodiment in 
the input rhythm pattern recognition process. 

[0169] FIG. 18 is a flowchart showing a detailed operation 

of the control section 102 of the fourth embodiment in the input 

20 rhythm pattern recognition process . Hereinafter, the operation 
of the control section 102 in the input rhythm pattern recognition 
process will be described with reference to FIG. 18. 
[0170] Firstly, the control section 102 memorizes a tap 

interval time time intervals as in the third embodiment (step S501) 

25 to determine whether or not the next tap is input (step S502) . 
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When the next tap is input, the control section 102 returns to 
the operation of step S501. On the other hand, when the next tap 
is not input (i.e., the user finishes inputting a rhythm), the 
control section 102 goes to an operation of step S503 to analyze 
5 a rhythm pattern. 

[0171] In step S503, the control section 102 determines 

whether or not the number of taps is one. When the number of taps 
is one, the control section 102 recognizes that the input rhythm 
pattern is xx x", and returns to the main operation of FIG. 6. 

10 [0172] On the other hand, when the number of taps is not one, 

the control section 102 obtains a smallest one of the obtained 
tap interval times time intervals (step S505) . Next, the control 
section 102 selects only one tap interval time time interval from 
the measured tap interval timco time intervals sequentially from 

15 the head (step S506) . Next, the control section 102 obtains 
relative values of the selected tap interval timco time intervals 
where the smallest tap interval time time interval is represented 
by 1 and determines whether or not the relative value exceeds a 
predetermined threshold (step S507) . The predetermined 

20 threshold is a relative value of a value obtained by adding a beat 
time and a silent beat time (e.g., 2). 

[0173] When the relative value exceeds the predetermined 

threshold, the control section 102 determines the pattern of the 
selected tap interval time time interval as "x-" (step S508), and 
25 goes to an operation of step S509. On the other hand, when the 



relative value does not exceeds the predetermined threshold, the 
control section 102 determines the pattern of the selected tap 
interval time time interval as u x" (step S510) , and goes to the 
operation of step S509. 
5 [0174] For example, when a smallest tap interval time time 

interval is 300 (ms) and a certain tap interval time time interval 
is 660 (ms), the relative value is 660/300=2.2. Assuming that 
the predetermined threshold is 2, a rhythm pattern having the 
elapsed tap interval time time interval 660 (ms) is determined 
10 to be "x-". 

[0175] In step S509, the control section 102 determines 

whether or not all of the measured tap interval times time intervals 
have been subjected to the relative value threshold test. When 
not all of the measured tap interval times time intervals have 

15 been subjected to the relative value threshold test, the control 
section 102 returns to the operation of step S506 and compares 
the next tap interval time time interval with the smallest tap 
interval time time interval . On the other hand, when all of the 
measured tap interval timco time intervals have been subjected 

20 to the relative value threshold test, the control section 102 
determines an input rhythm pattern based on the pattern determined 
in step S508 and/or S510, returns to the main operation of FIG.- 6 
to determine matching of a registered rhythm pattern, and controls 
an in-vehicle apparatus. 

25 [0176] As described above, in the fourth embodiment, the 



control system obtains the relative value of each tap interval 
time time interval where the smallest tap interval time time 
interval is 1 to determine whether or not there is a silent beat 
in the tap interval time time interval . Therefore, it is possible 
5 to recognize a rhythm pattern by considering the whole rhythm 
thereof irrespective of the tempo thereof . Therefore, the control 
system can absorb differences among individual users to recognize 
an input rhythm pattern. Therefore, it is possible to control 
an operation of each apparatus more reliably as compared to when 

10 an input rhythm pattern is recognized by simply comparing a tap 
interval time time interval with a prolonged sound interval. 

(Fifth Embodiment) 
[0177] A whole structure of a system according to a fifth 

embodiment of the present invention is similar to that of the first 

15 embodiment, and therefore, FIG. 1 is referenced in the fifth 
embodiment. In the fifth embodiment , the rhythm input section 101 
is assumed to be composed of an analog input device. Also in the 
fifth embodiment, the position of an accent is used for recognition 
of a rhythm pattern. A rhythm dictionary , such as that of FIGS . 11 

20 and 12, which defines the strong and weak levels as well, is used. 
[0178] Hereinafter, an operation of the control section 102 

according to the fifth embodiment will be described. A main 
operation of the control section 102 when a rhythm is input by 
the user is similar to that of the first embodiment, and therefore, 

25 FIG. 6 is referenced. The fourth fifth embodiment is different 



from the first embodiment in the input rhythm pattern recognition 
process . 

[0179] FIG. 19 is a flowchart showing a detailed operation 

of the control section 102 of the fifth embodiment in the input 
5 rhythm pattern recognition process will be described. 
Hereinafter, the operation of the control section 102 in the input 
rhythmpattern recognitionprocess willbe described with reference 
to FIG. 19. 

[0180] Firstly, the control section 102 receives an input 

10 rhythm signal from a rhythm input section 101, and memorizes an 
amplitude level at a key-down timing time (step S601) . Next, the 
control section 102 measures and memorizes a tap interval time 
time interval (step S602 ) . Note that, when a key-down timing time 
occurs for the first time, the control section 102 does not measure 

15 a tap interval time time interval and goes to the next operation. 
[0181] Next, the control section 102 determines whether or 

not the next tap is input within an end interval time time interval 
(step S603) . When the next tap is input, the control section 102 
returns to the operation of step S601. When the next tap is not 

20 input, the control section 102 goes to an operation of step S604. 
[0182] In step S50 4 S604 , the control section 102 recognizes 

an input rhythm pattern without considering the intensity of a 
tap. Here, an algorithm for recognizing an input rhythm pattern 
may be the same as that of any of the above-described first, third 

25 and fourth embodiments. 



[0183] Next, the control section 102 selects an amplitude 

level at each key-down timing time of the input rhythm signal 
sequentially from the head thereof (step S605) , and determines 
whether or not the amplitude level indicates a strong beat or a 
5 weak beat (step S606) . 

[0184] When the amplitude level indicates a strong beat, the 

control section 102 determines a strong/weak pattern as "strong" 
(step S607), and goes to an operation of step S608. Here, the 
strong/weak pattern refers to a pattern which indicates a beat 

10 portion of the input rhythm pattern recognized in step S604 is 
a strong beat or a weak beat . On the other hand, when the amplitude 
level indicates a weak beat, the control section 102 determines 
the strong/weak pattern as "weak" (step S609) and goes to the 
operation of step S608. 

15 [0185] In step S608, the control section 102 determines 

whether or not all key-down timings times have been selected . When 
all key-down timings times have not been selected, the control 
section 102 returns to the operation of step S605 and determines 
the next strong/weak pattern . On the other hand, when all key-down 

20 timings times have been selected, the control section 102 combines 
the input rhythm pattern recognized in step S604 with the 
strong/weak pattern recognized in steps S607 and S609 to determine 
a final input rhythm pattern (step S610) , returns to the main 
operation of FIG. 6, determines whether or not there is a matching 

25 rhythm pattern with reference to a rhythm dictionary defining 
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intensities , and controls an operation of an in- vehicle apparatus . 
[0186] The combination of the input rhythm pattern and the 

strong/weak pattern in step S610 is performed by assigning a 
strong/weak pattern to each beat portion of the rhythm pattern 
5 sequentially from the head thereof. For example, when the input 
rhythm pattern is "x-xxxx" and the strong/weak pattern 
"strong-weak-strong-weak-weak", the control section 102 assigns 
"strong" or "weak" to the beat portions of the input rhythm pattern 
sequentially. When the beat portion is "strong", the pattern is 

10 changed to "A". In this combination, the control section 102 can 
recognize a final input rhythm pattern "A-xAxx". 
[0187] As described above, in the fifth embodiment, an input 

rhythm pattern can be recognized in association with the intensity 
of a beat. Particularly, by combining the input rhythm pattern 

15 recognition process of the fifth embodiment with those of the third 
and fourth embodiments, the control system can recognize a rhythm 
pattern in association with the intensity thereof by considering 
the whole rhythm thereof irrespective of the tempo thereof. 
[0188] Note that the intensity of a beat also varies among 

20 individuals, and therefore, the control system may determine the 
intensities of beats relatively with reference to the lowest or 
highest beat level. 

(Sixth Embodiment) 
[0189] A pronunciation pattern may vary from user to user, 

25 and therefore, an input rhythm pattern may also vary from user 
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to user. In a sixth embodiment , a rhythm dictionary in which a 
different rhythm pattern is registered for each user and a system 
in which the user can edit a registered rhythm pattern to match 
the user's input rhythm pattern will be described. 
5 [0190] FIG. 20 is a diagram showing a whole structure of a 

control system 600 according to the sixth embodiment of the present 
invention and a system to which the control system 600 is applied. 
In FIG. 20, portions similar to those of the first embodiment are 
indicated with the same reference numerals and will not be 
10 explained. 

[0191] In FIG. 20, the whole system comprises the control 

system 600, an air conditioner 201, an audio player 202, a 
television 203, and a car navigation system 204. The control 
system 600 includes a rhythm input section 601, a control 
15 section 602, a personal data/rhythm dictionary storage 
section 603, an output section 604, and an authentication 
section 605. 

[0192] The rhythm input section 601 may be either a digital 

input device or an analog input device. 

20 [0193] The personal data/rhythm dictionary storage 

section 603 is composed of a memory device, such as a RAM, a ROM, 
a hard disk or the like. The personal data/rhythm dictionary 
storage section 603 stores, for each user, a rhythm dictionary 
table, a parameter required for recognition of an input rhythm 

25 pattern, and setting information about a feedback method. 
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[0194] Here, the rhythm dictionary tables which are different 

from that of each other user are defined by the user previously 
registering rhythm patterns in association with the names of the 
contents of controls. The parameter required for recognition of 
5 an input rhythm pattern (hereinafter referred to as a recognition 
parameter) refers to information required for detection of a 
temporal change in an input rhythm signal, such as a threshold 
for beat and silent beat levels (see FIGS. 3 and 9), a threshold 
for strong beat and weak beat levels (see FIG. 10), a prolonged 
10 sound interval — time time interval , an end interval — time time 
interval , and the like. 

[0195] The setting information about a feedback method 

(hereinafter referred to as feedback setting information) refers 
to information indicating whether contents to be fed back to the 

15 user are screen display, voice output, or vibration. 

[0196] The output section 604 is composed of a screen 

apparatus (e.g., a display , etc.), a voice apparatus (e.g., a 
loudspeaker, an amplifier, etc.), a vibration apparatus (e.g., 
a vibrator, etc.), or the like, i.e., the output section 604 is 

20 a sensation apparatus for giving a certain stimulus to the five 
senses of the user. 

[0197] The authentication section 605 is an apparatus for 

authenticating an individual user, whose structure varies 
depending on the authentication method. Examples of the 
25 authentication method include a method of authentication using 
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a password input by the user, a method of authentication by 
recognition of an image (e.g., a face, an iris, a fingerprint, 
etc. ) , a method of authentication using input handwriting or voice, 
and the like. In this embodiment, security is not particularly 
5 taken into consideration, and therefore, only an authentication 
method such that, for example, the user simply selects his/her 
own name from a user list before use, is used. The authentication 
section 605 authenticates and identifies the user in response to 
a request from the control section 602, and returns the result 

10 to the control section 602. 

[0198] The control section 602 is composed of a CPU, a memory 

and the like. The control section 602 identifies the user based 
on information from the authentication section 605, and analyzes, 
for each user, an input rhythm signal output by the rhythm input 

15 section 601 with reference to the recognition parameter stored 
in the personal data/rhythm dictionary storage section 603 to 
recognize an input rhythm pattern. An algorithm for recognizing 
an input rhythm pattern may be any of the algorithms used in the 
above-described first to fifth embodiments. The control 

20 section 602 references user-specific rhythm dictionary tables 
stored in the personal data/rhythm dictionary storage section 603 
to determine whether or not there is a registered rhythm pattern 
which matches the recognized input rhythm pattern. When there 
is a matching registered rhythm pattern, the control section 602 

25 feeds a result of the determination via the output section 604 
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back to the user and controls an operation of an in-vehicle 
apparatus . 

[0199] FIG. 21 is a flowchart showing an operation of the 

control section 602 in which the control section 102 602 recognizes 
5 a rhythm input by the user tapping the rhythm input section 4r&i 
601 to control an operation of an in-vehicle apparatus. 
Hereinafter, the operation of the control section 602 will be 
described with reference to FIG. 21. 

[0200] Firstly, the control section 602 requests the 

10 authentication section 605 to identify and authenticate an 
individual user, and receives a result of the authentication 
(step S701) . Next, the control section 602 determines whether 
or not there is an input by the user based on whether or not an 
electrical signal is received from the rhythm input section 601 

15 (step S702) . When there is no input by the user, the control 
section 602 ends the process . On the other hand, there is an input 
by the user, the control section 602 references a recognition 
parameter relating to the identified user from the personal 
data/rhythm dictionary storage section 603 (step S703) , and goes 

20 to an operation of step S704. 

[0201] In step S704, the control section 602 recognizes a 

rhythm pattern based on the input rhythm signal from the rhythm 
input section 601 and the referenced authentication recognition 
parameter. An algorithm for recognizing a rhythm pattern may be 

25 any of the algorithms used in the above-described first to fifth 
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embodiments. The control section 602 can use a user-specific 
authentication recognition parameter to absorb differences among 
individuals in the timing or intensity of beat, thereby recognizing 
an input rhythm pattern. 
5 [0202] Next, the control section 602 determines whether or 

not a registered rhythm pattern which matches the recognized input 
rhythm pattern is registered in the rhythm dictionary table of 
the user (step S705) . When there is a matching registered rhythm 
pattern, the control section 602 performs the contents of a control 

10 corresponding to the rhythm pattern to control an operation of 
an in-vehicle apparatus (step S706) , and outputs a feedback signal 
indicating the success of the control along with feedback setting 
information to the output section 604 (step S707) and ends the 
process. On the other hand, when there is no matching registered 

15 rhythm pattern, the control section 602 outputs a feedback signal 
which indicates the failure of the recognition along with feedback 
setting information to the output section 604 (step S708) , and 
ends the process. The output section 604 informs the user of 
whether or not the recognition has been successful, using voice, 

20 video, vibration or the like, based on the feedback signal and 
the feedback setting information from the control section 602. 
[0203] FIG. 22 is a flowchart showing an operation of the 

control section 602 when the user confirms/edits the contents of 
a rhythm dictionary table. Hereinafter, the operation of the 

25 control section 602 when the user confirms/edits the contents of 



a rhythm dictionary table will be described with reference to 
FIG. 22. 

[0204] Firstly, when starting confirming/editing a rhythm 

dictionary, the control section 602 displays options, such as 
5 "ADD/MODIFY", "CONFIRM" , "DELETE" and the like, on a screen of 
the output section 604 and causes the user to select an item 
(step S801) . 

[0205] Instep S801, when the user selects "ADD", the control 

section 602 displays options, such as "INPUT BY CHARACTER", "INPUT 

10 BY RHYTHM" and the like, on the screen of the output section 604, 
and waits for an input by the user (step S802). 
[0206] In step S802, when the user selects INPUT BY RHYTHM, 

the control section 602 receives an input rhythm signal from the 
rhythm input section 601 (step S803) , recognizes an input rhythm 

15 pattern (step S804), and goes to an operation of step S807. An 
algorithm for recognition of an input rhythm pattern in step S804 
is any of the algorithms described in the first to fifth embodiments . 
[0207] Instep S802, when the user selects INPUT BY CHARACTER, 

the control section 602 receives characters input by the user via 

20 a character input section (not shown) , such as a keyboard, a speech 
recognition section or the like (step S805) , and converts the 
characters into a rhythm pattern (step S806) , and goes to the 
operation of step S807. In step S806, as shown in the first or 
second embodiment, the control section 602 divides the input 

25 characters into predetermined units and assigns the divided units 
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respective predetermined unit rhythm patterns, thereby converting 
the input characters into a rhythm pattern. 

[0208] In step S807, the control section 602 checks whether 

or not the rhythm pattern determined in step S804 or S806 is a 
5 duplicate of an existing registered rhythm pattern stored in the 
personal data/rhythm dictionary storage section 603 . The number 
of possible rhythm patterns is infinite, so that there may be a 
duplicate rhythm pattern. Therefore, the control section 602 
performs determination, such as that of step S807. 

10 [0209] When there is a duplicate registered rhythm pattern, 

the control section 602 returns to step S802, and prompts the user 
to enter an input again. On the other hand, when there is no rhythm 
pattern, the control section 602 registers a new rhythm pattern 
and the contents of a new control into the personal data/rhythm 

15 dictionary storage section 603 (step S808) , and ends the process . 
Note that, when MODIFY is performed, the control section 602 
changes a rhythm pattern corresponding to the registered name of 
the contents of a control to a new rhythm pattern. In this case, 
the user may specify the contents of the control or the control 

20 section 602 causes the user to select the contents of the control. 
Thus, the control section 602 causes the user directly to tap a 
rhythm to register a rhythm pattern, or causes the user to input 
characters to register a rhythm pattern, thereby editing the 
registered contents of a rhythm dictionary table. 

25 [0210] Back to the description of the operations of step S801 



and thereafter. In step S801, when the user selects "CONFIRM", 
the control section 602 uses the output section 604 to cause the 
user to sense a selected registered rhythm pattern (step S809) , 
and ends the process. Specifically, the output section 604 
5 displays an animation pattern on a screen, outputs a voice pattern, 
or outputs a vibration pattern in accordance with a tempo of a 
beat (a strong beat or a weak beat when the beat has intensity 
levels) and/or a silent beat of the registered rhythm pattern. 
Thereby, the user can sense the registered rhythm pattern. 

10 [0211] In step S801, when the user selects "DELETE", the 

control section 602 deletes an item corresponding to a selected 
rhythm pattern from the personal data/rhythm dictionary storage 
section 603 (step S810) , and ends the process. 
[0212] As described above, in the sixth embodiment, the 

15 control system registers a rhythm dictionary table, a recognition 
parameter, and feedback setting information for each user, and 
changes information to be referenced, depending on the user. 
Therefore, it is possible to reduce a situation such that a rhythm 
pattern is not recognized due to differences among individuals, 

20 such as the way or tempo of beating a rhythm or the like. 

[0213] Further, the control system can inform the user of 

the result of recognition of a rhythm pattern, so that the user 
can confirm whether or not a correct rhythm has been input. 
[0214] Furthermore, the control system can cause the user 

25 to sense a registered rhythm pattern, so that the user can learn 
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the registered rhythm pattern. 

[0215] Furthermore, the control system can edit a rhythm 

dictionary, corresponding to a rhythm or characters input by the 
user. Therefore, it is possible to construct a customized rhythm 
5 dictionary. 

(Seventh Embodiment) 
[0216] Next, a seventh embodiment of the present invention 

will be described. A structure of a control system according to 
the seventh embodiment and a whole structure of a system to which 

10 the control system is applied are similar to those of the first 
embodiment, and therefore, FIG. 1 is referenced. In the seventh 
embodiment, a larger number of functions are assigned rhythm 
patterns by defining the functions in a hierarchical manner. 
[0217] FIG. 23 is a diagram schematically showing a position 

15 in a vehicle of a rhythm input section 101 according to the seventh 
embodiment where the rhythm input section 101 is an analog input 
device composed of a piezoelectric sensor. This embodiment is 
characterized in that the rhythm input section 101 includes two 
or more input devices . The rhythm input section 101 incorporates 

20 a piezoelectric sensor 302L which is disposed on a left-hand 
portion of a steering wheel 301 and a piezoelectric sensor 302R 
which is disposed on a right-hand portion of the steering wheel 301 
in order to enable the driver to easily beat them while driving. 
As in the first embodiment, a projection is provided at responsive 

25 portions of the piezoelectric sensors 302L and 302R. Note that 
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any structure which can be easily found by groping may be used 
instead of a projection. Note that FIG. 22 is for illustrative 
purpose only. The two input devices may be disposed on other 
portions, such as upper and lower positions or the like, instead 
5 of the left- and right-hand positions. 

[0218] FIG. 24 is a diagram showing an exemplary rhythm 

dictionary table stored in the rhythm dictionary storage 
section 103. Here, the contents of control commands are divided 
into two hierarchical structure layers: a large function; and a 

10 small function appending therebelow. 

[0219] A rhythm pattern input from the left-hand portion 

piezoelectric sensor 302L is assigned to an input of a large 
function. A rhythm pattern input from the right-hand portion 
piezoelectric sensor 302R is assigned to an input of a small 

15 function. For example, a large function "Hj^S;^ ( keirotansaku) " 
(path search) is selected by tapping a rhythm "x-xx-xx" on the 
left-hand portion. Thereafter, a small function w S 35 ( j itaku) " 
(home) appending to the large function "SJJ§$;^ ( keirotansaku) " 
(path search) is selectedby tapping a rhythm "xxx" on the right-hand 

20 portion. The control section 102 interprets the combination of 
the two inputs, and controls an operation of an in-vehicle apparatus, 
such as, for example, causing a car navigation system to search 
for a path to home and start guiding. 

[0220] FIG. 25 is a flowchart showing a detailed operation 

25 of a control section 102 in a rhythm pattern recognition process . 
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Hereinafter, the operation of the control section 102 in the rhythm 
pattern recognition process will be described with reference to 
FIG . 25. 

[0221] The control section 102 sets a head pattern as "x" 

5 (step S901) , and determines whether or not the next tap is input 
within an end interval time time interval (step S902) . When the 
next tap is not input, the control section 102 ends the process. 
On the other hand, when the next tap is input , the control section 102 
determines whether or not a tapped sensor is on the same side as 
10 that of the previously tapped sensor (step S903) . Here, thesensor 
refers to the piezoelectric sensor 302L, 302R (the same is 
hereinafter true) . 

[0222] When a sensor on a different side is tapped, the control 

section 102 determines the next pattern as "|x" (step S907) , and 

15 returns to the operation of step S902. Here, "I" is a code 
representing the beginning or end of a word, i.e., indicating a 
time at which the user switches the sensors to be tapped. 
[0223] On the other hand, when the tapped sensor is on the 

same side as that of the previous tap, the control section 102 

20 determines whether or not the tap interval time time interval is 
within the prolonged sound interval time time interval (step S904) , 
and a result of the determination, determines a pattern as w x" 
or xx -x" (step S905 or S906) , and returns to the operation of 
step S902. 

25 [0224] When the tapped sensor is switched in the 

68 



above-described manner, " |" is inserted into the rhythm pattern. 
When determining the presence or absence of a matching pattern, 
the control section 102 determines whether or not " | " is inserted. 
When " |" is inserted, the control section 102 determines whether 
5 a large function or a small function is being performed. When 
the large function is being performed, the control section 102 
determines a matching rhythm pattern registered in the small 
function to control an in-vehicle apparatus. On the other hand, 
when the small function is being performed, the control section 102 
10 determines a matching rhythm pattern registered in the large 
function to control an in-vehicle apparatus. 

[0225] As described above, in the seventh embodiment, the 

control systemautomatically inserts the code indicating switching 
of hierarchical layers when the tapping sides are switched. When 

15 the code indicating switching of hierarchical layers is inserted, 
the control system switches rhythm dictionaries for determining 
matching of rhythm patterns, and references the corresponding 
rhythm dictionary to determine matching of rhythm patterns. 
Therefore, the control system can perform a control corresponding 

20 to a function of each hierarchical layer. Further, since the 
functions are organized into the hierarchical structure , the number 
of the control contents which can be performed by the control system 
can be increased. 

[0226] Although an example of the two-layer hierarchical 

25 structure is shown in this embodiment, functions can be divided 
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into three layers. In this case, for example, the highest layer 
is assigned to a left-hand portion sensor, the second layer is 
assigned to a right-hand portion sensor, and the third layer is 
assigned to the left-hand portion sensor again . The control system 
5 switches rhythm dictionaries to be used in accordance with a 
sequence of beating the left-hand portion, the right-hand portion 
and the left-hand portion . For example, when the left-hand portion 
is switched to the right-hand portion during determination in the 
first hierarchical layer, the control system recognizes transition 

10 from the first hierarchical layer to the second hierarchical layer. 
When the right-hand portion is switched to the left-hand portion 
during determination in the second hierarchical layer, the control 
section recognizes transition from the second hierarchical layer 
to the third hierarchical layer. When the left-hand portion is 

15 switched to the right-hand portion during determination in the 
third hierarchical layer, the control system recognizes return 
from the third hierarchical layer to the first hierarchical layer. 
[0227] Similarly, the hierarchical structure may have four 

or more layers. In this case, the control system recognizes a 

20 hierarchical layer after transition based on a current hierarchical 
layer and the sequence of the switching sensors and references 
to a rhythm dictionary corresponding to the hierarchical layer. 
[0228] Although a sensor is provided at two positions (i.e., 

the left-hand portion and the right-hand portion) in the seventh 

25 embodiment, the number of sensors provided is not limited to two. 
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This is because the essence of this embodiment is to detect switching 
of sensors. Thus, a plurality of sensors are only required. 
[0229] Note that the control system of the seventh embodiment 

may further comprise a function of memorizing a user-specific 
5 setting and a function of feeding it back as in the sixth embodiment . 
[0230] Although the seventh embodiment shows a process of 

determination based on comparison of an input rhythm pattern with 
a prolonged sound interval time time interval to recognize the 
input rhythm pattern, a process of recognizing a hierarchical 

10 structure may be applied to an input rhythm pattern recognition 
process, such as those used in the second to fifth embodiments. 
[0231] Specifically, in the rhythm pattern recognition 

process of the second embodiment, the control system determines 
whether or not the next tap is input within the end interval time 

15 time interval (see step S304 in FIG. 13), and thereafter, 
determines switching based on whether or not the same sensor as 
the previous one is tapped, and determines a rhythm pattern 
corresponding to the intensity of a beat. 

[0232] Further, in the input rhythm pattern recognition 

20 process of the third embodiment, when recording a tap interval 
time time interval (see step S401 in FIG. 14) , the control system 
also determines switching of the sensors, and recognizes a rhythm 
pattern for each hierarchical layer in step S405 and thereafter. 
The same is true of the fourth and fifth embodiments. 
25 (Other Embodiments) 
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[0233] The present invention is not construed to be narrowly 

limited to the contents of the above-described embodiments. 
[0234] Firstly, in each of the above-described embodiments, 

a rhythm input section constituting a piezoelectric sensor or a 
5 contact switch which serves as an operating device is provided 
on a steering wheel. A place where the rhythm input section is 
provided is not limited to this. The rhythm input section may 
be provided in any place, such as an armrest portion of a chair, 
the inside of an instrument panel, a back seat or the like, as 

10 with conventional operating device. 

[0235] Although the control of in-vehicle apparatuses is 

illustrated in each of the above-described embodiments, the scope 
of the present invention is not limited to an in-vehicle system. 
For example, by providing a rhythm input section in a home apparatus, 

15 such as a television, a video recorder or the like, the user can 
operate these apparatuses by inputting a rhythm in a similar manner . 
[0236] Further, communication between a rhythm input section 

and an apparatus may be performed in either a wireless or wired 
manner. For example, when wireless communication is performed, 

20 the rhythm input section may be provided on a remote controller, 
but not on the apparatus body. 

[0237] Further although the control system is separated from 

each apparatus in each of the above-described embodiments, the 
control systemmay be incorporated in each apparatus . For example, 
25 the control section of each of the above-described embodiments 



may be implemented by executing a control program on a CPU in a 
computer, the rhythm input section may be implemented as a mouse, 
a keyboard and a virtual input pad displayed on a screen, and the 
rhythm dictionary may be implemented and stored in a hard disk. 
5 A rhythm may be input by clicking the mouse or the like on the 
input pad to execute the startup or a command of various kinds 
of software on a PC. 

[0238] For example, when wishing to start up word processor 

software, the user clicks the mouse on the virtual input pad in 

10 accordance with a rhythm produced by uttering a word "!7 — 37* P 
(wapuro) " (word processor) . The CPU which is executing a control 
program compares the rhythm with the rhythm dictionary, and 
depending on the result, starts up the word processor software. 
The control program on the PC is a program for causing the CPU 

15 to perform an operation, such as that of FIG. 6. Specifically, 
when there is a matching rhythm pattern, step S105 of FIG. 6 only 
needs to be replaced with an operation of executing corresponding 
software . In this case, the control system is provided as a control 
program which is capable of starting up various kinds of software 

20 and executing commands and is executed on a computer apparatus. 

INDUSTRIAL APPLICABILITY 
[0239] As described above, the control system of the present 

invention can reliably perform a desired function in accordance 
25 with an operation instruction from the user using a small number 
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of operating devices. 
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ABSTRACT 

A control system for reliably performing minimally required 
operations using a small number of input devices is provided. A 
rhythm input section (101) converts a rhythm pattern input by the 
5 user to an electrical signal, which is in turn output. A rhythm 
dictionary storage section (103) stores a rhythm dictionary table 
which associates the contents of a control of an apparatus with 
a registered rhythm pattern. The registered rhythm pattern is 
obtained by typifying a pronunciation pattern of a name indicating 

10 the contents of the control. A control section (102) analyzes 
the electrical signal from the rhythm input section (101) to 
recognize the input rhythm pattern input by the user, recognizes 
the contents of a corresponding control by referencing the rhythm 
dictionary storage section (103), and controls an operation of 

15 an in-vehicle apparatus. 
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